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Executive Summary 



After-school or out-of-school programs offer additional social, academic, and 
extracurricular activities and experiences to supplement the regular school day. College 
preparation programs offer activities that are designed to enable youth to prepare for a variety of 
college-related tasks, including test preparation, academic tutoring, admission essay writing, and 
assistance with college and financial aid applications. This paper provides a sense of what kinds 
of temporal sequencing is more likely to have benefits than others. To do this, we offer a brief 
definition of after-school programs and then move onto a closer consideration of the timing of 
college preparation programs. An outline of our discussion is as follows: 

Defining After-School Programs and College Preparation Programs 

• Program Participants 

• Types of Services 

• Service Providers 

• Program Funders 

Structure and Time in College Preparation Programs 

• Attendance 

• Participation 

• Duration 

• Intensity 

Spending Time: Where Do We Go From Here? 

• Clarify Goals 

• Develop a Timeframe that Meets the Program’s Goals 

• Enable Students and Parents to Understand the Importance of Attendance and 
Participation 

• Develop an Evaluation Schema that Investigates Temporal Dimensions 

A high performing program is one in which the various components are in sync with one 
another and out-of-school time is spent in a manner that supports the goals that the program 

participants have set for themselves. 
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Introduction 



Students in the K-12 system spend about 20% of their time in school and 80% of their 
time engaging in other pursuits. Critical Hours: After- School Programs and Educational Success 
(2006) asserts that after-school and out-of-school programs have the potential to maximize part 
of this 80% of available non-school time. As terms, after-school and out-of-school have been 
used by educational researchers for almost a century to describe a variety of programs that serve 
students after the regular school day ends (Halpem, 2002; Arbreton et al, 2005). Examples of 
after-school or out-of-school programs include an athletic program in the evenings at the Boys 
and Girls Club, a homework program at a public school, or an intensive academic program 
during winter, spring, or summer vacation. Additionally, these programs may be designed to 
provide daycare for very young children while their parents are at work, social activities for 
grade school youth to keep them engaged in supervised after-school activities, or offer a chess 
club run by the community center. Generally defined, after-school or out-of-school programs 
offer additional social, academic, and extracurricular activities and experiences to supplement 
the regular school day. 

College preparation programs offer activities that are designed to enable youth to 
prepare for a variety of college-related tasks, including test preparation, academic tutoring, 
admission essay writing, and assistance with college and financial aid applications. In this light, 
a softball league for high school girls or bible study for teenage Catholics might be worthwhile 
activities, but they do not have as the explicit mission of preparing students for college. Even 
when one winnows down out-of-school programs and looks at college preparation programs, 
several conundrums persist. Eirst, the term has two implicit assumptions that turn out to be true 
with the vast array of such programs. On one hand, timing is an issue; college preparation 
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programs generally begin in high school. On the other hand, the internal temporal framework for 
these programs does not pertain to what takes place during a typical school day or year. College 
discussions may not be part of a student’s regular school day experiences, especially in schools 
with a history of low college going. In short, college preparation programs generally occur 
between 9* and 12* grade and refer to out-of- school activities. 

College preparation programs have multiple tasks, goals, and objectives. Who funds them 
and how they are structured vary from program to program. Most importantly and for the 
purpose of this paper, how programs structure their temporal frameworks is equally varied. As 
we elaborate below, one model most likely is not the solution insofar as multiple goals need to be 
accomplished in preparing youth for college. Yet, it causes concern when one looks at the 
literature about college preparation programs and discovers no sense of best practice in general, 
and with regard to timing in particular (Bonous-Hammarth & Allen, 2005; Hayward et ah, 1997). 

Accordingly, we consider a framework for thinking about college preparation programs 
within the broader rubric of out-of-school programs, delineate how to think about time in college 
preparation programs, and suggest ways to develop a framework for evaluating the adequacy of a 
temporal framework. The purpose is less to put forth a tested model for the temporal 
effectiveness of these programs. Unfortunately, few such evaluations have been done and seem 
unlikely to occur in the near future. However, based on the current literature, what we are able to 
put forward is a sense of what kinds of temporal sequencing is more likely to have benefits than 
others. To do this, we offer a brief definition of after-school programs and then move onto a 
closer consideration of the timing of college preparation programs. 

Defining After-School Programs 
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Fashola (1998) sorts out-of-school programs into three types of arrangements: 

Daycare: recreational/cultural activities, ‘safe haven’, Pre-K through requires 
licensing 

- After-school programs: ages 5-18, academic and non-academic activities, helps 
student make creative use of time 

School-based academic extended-day programs: directly connect to the school day, 
mix of academic/recreational/cultural programs, regular school-day teachers or 
paraprofes sionals . 

Within these definitions, Fashola delineates age ranges, types of activities, and programmatic 
goals. For example, within the context of school-based academic extended-day programs, regular 
school day teachers and other paraprofessionals who are training in some part of the college 
preparation process are employed to offer a combination of academic, social, and mentoring 
programs to college bound students. 

Miller’s (2006) review of research on after-school programs has found that “youth benefit 
from consistent participation in well run, quality after-school programs” (pg. 8). She suggests 
that such programs offer three main advantages to students. These advantages include: (a) an 
increased overall engagement in learning; (b) an increase in overall educational equity; and (c) 
an increase in skills that are necessary for success in today’s economy. Such returns may be due 
to increased instructional time as well as enhanced opportunities for completing difficult college 
admission and applications process - such as writing a college admission essay or learning how 
to read a financial aid letter. 

There has been inconsistency and disagreement among scholars concerning the 
parameters used in defining out-of-school and after-school programs. Frequently using the terms 
interchangeably, scholars provide little distinction between tout-of-school (Hofferth & Sandberg, 
2001; Lind et al, 2006; Chaput, Little, & Weiss, 2004) and after-school time (Fashola, 1998; 



3 




Halpern, 1999; 2000; 2002; Hollister, 2003) in their evaluation of programs. Roth and Brooks- 
Gunn (2003) added the term “youth development programs’ to the discussion; however, their 
research analyzes programs with marked similarities to programs described as out-of-school or 
after- school. 

A current body of research suggests that programs provide services ranging from 
academic support (Padgette, 2003; Roth & Brooks-Gunn, 2003; Fashola, 1998; Halpern, 1999; 
2000; 2002) and enrichment (Fashola, 1998; Halpern, 1999; 2000; 2002) to crime prevention 
(Padgette, 2003; Chaput, Little & Weiss, 2004; Fashola, 1998) and a safe environment (Padgette, 
2003; Roth & Brooks-Gunn, 2003). Padgette (2003) suggests out-of-school time programs 
provide structured activities for students between the ages of 5 and 18. There is also mention of 
programs providing health education (Padgette, 2003), socialization (Roth and Brooks-Gunn, 
2003; Chaput, Little and Weiss, 2004; Fashola, 1998) and unstructured time (Halpern, 1999; 
2000; 2002). Halpern (2000) found that most evening after-school programs have a similar 
structure: homework, arts/crafts/games, physical activity, expressive arts or cultural activity, 
tutoring and reading time, and science activity. However, there is less consistency in programs 
that are working with students during the weekends or school breaks. 

It is easy to understand why college preparation programs fit within basic definitions of 
after-school programs. College Summit is an example of an after-school program that largely 
occurs in the summer for prospective 12* graders to help them apply for college. AVID 
(Advancement via Individual Determination) is a program that takes place either before or after- 
school on-site to provide college knowledge for students. Obviously, many programs such as 
MESA (Math, Engineering, Science, and Achievement) might be considered “blended” insofar 
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as the club’s activities frequently occur at school during lunch or a free period, but the science 
fairs often occur on a weekend. 

However, such varied definitions provide little sense of the program structure or 
timeframes that exist for one or another activity. Consider, for example, that if one were to ask a 
student in California, Nebraska, or Maine what he or she did during the day and the response was 
“I go to high school” that the likelihood is that the school day’s structure is more similar than 
different across the nation. The student will begin school around 7:30 AM and conclude by about 
2:30 PM. The school year will start around September and finish in June. Even in overcrowded 
schools such as in Los Angeles, if one were to ask a student what track he or she were on, there 
are only 3 options - A, B, and C. The track determines when all students in that track are in and 
out school. 

No such commonalities exist with out-of-school programs or college preparation 
programs. If students say they participate in an after-school college preparation program, they 
may attend one that occurs in the summer for one month, after-school, one day a week, or simply 
a voluntary meeting about the college application process. Such variation may be warranted, but 
surely, some frameworks must be more effective than others. Given the varied use of the terms, 
one way to focus how college preparation programs might be defined is to consider four 
components of any project and discuss the temporal aspects of these components: (a) program 
participants; (b) types of services; (c) service providers; and (d) program funders. 

Program Participants 

A review of the literature on college preparation programs generally refers to services for 
low-income youth (Gandara & Bial, 2001; Gullatt & Jan, 2003; Weiss et. ah, 2006). The 
assumption is that poor youth attend schools that do not adequately prepare them for college. The 
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claim’s evidence is based on the relatively low rates of college going for schools in these areas 
(Venezia, Kirst, & Antonio, 2003). Although college preparation programs exist in high 
performing schools and/or in upper-income neighborhoods, such programs often buttress what 
takes place during the school day. Whereas in low-income schools, these programs are trying to 
make up what was not learned in school. The result is that the quality of programming for 
students’ after-school hours is not equally distributed across socioeconomic groups. 

Duffett and Johnson (2004) found that on almost every measure of program adequacy the 
parents of low-income and minority students reported a greater level of dissatisfaction with after- 
school opportunities. Of the parents surveyed, approximately half sought programs with 
homework support and more than 60% were concerned that their children would academically 
regress during summer months, putting them further behind more advantaged students. The 
demand for after-school and summer programs in low-income neighborhoods far exceeds the 
availability of programs nationwide (Padgette, 2003). Over 75% of low-income parents reported 
limited, affordable options during the summer months and inter-sessions (Duffett & Johnson, 
2004). As noted above, the vast majority of students who participate in college preparation 
programs are in high school. Although an increasing amount of literature points out the 
importance of beginning discussions about college in junior high school or even earlier (National 
Association for College Admission Counseling, 1999; National Association of Secondary School 
Principals, 1996; U.S. Department of Education, 1999), most programs do not begin until 9* 
grade (Immerwahr, 2003; Noeth & Wimberly, 2002). Most programs focus on high school 
juniors and seniors. 

Types of Services 
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Although some programs have more than one goal, virtually all college preparation 
programs have one of six purposes (Gullatt & Jan, 2003). These purposes include: college 
admission information, assistance to students and families, motivational activities, academic 
enrichment and support, and counseling and advising programs. The timing and implementation 
of the services vary widely. The Neighborhood Academic Initiative (NAI) attempts to increase 
the academic proficiency of students over a series of years. NAI offers a rare example of a 
sustained program that begins in junior high school. The assumption of this program is that 
students need to be academically prepared for college, and only long-term intensive involvement 
will foster and maintain high learning. Program offerings are most intense in the 1 1* and 12* 
grades when students take college admission exams and apply for college. 

Other programs such as SummerTIME or Aggie Texas Summer Institute focus on 
particular services at specific times in the college preparation process. SummerTIME serves as a 
writing and college knowledge boot camp for 12* grade students during the summer before they 
begin college. As one might suspect, a boot camp is a short-term intensive undertaking. The 
Aggie Texas Summer Institute highlights the selection of a career and the identification of the 
appropriate types of postsecondary training needed to meet those goals. Students who participate 
in this program meet for one or two 2-week sessions and are limited to 11* or 12* grade 
students. SAT preparation generally occurs in the junior or senior year for low-income youth and 
is a short course over a series of weeks. Einally, some programs focus less on academic activities 
and more on a love of learning approach that tries to stimulate student excitement in areas such 
as science, math, and computer science. These programs may take place over a relatively long 
time horizon (e.g. MESA) or may simply be a summer program such as the math and science 
programs at Massachusetts Institute of Technology and California Technical Institute. 
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Another set of college preparation activities is related to mentoring and counseling. 
Although these services may offer students more guidance related to the structural processes of 
applying to college, the more common focus is socio-emotional support than enables students to 
believe in themselves and their ability to go to college. These sorts of programs frequently last 
over a long tenure and begin in high school. The problem, however, is the maintenance of the 
specific mentor-mentee relationship. As Grossman and Rhodes note in a study they conducted, 
“half of all youth mentoring relationships dissolve after only a few months, often as the 
volunteers feeling overwhelmed, burned out, or unappreciated” (2002, p. 200). Their findings 
suggest that a mentoring relationship must last a minimum of six months for students to benefit. 
A short tenure of a relationship can have negative emotional effects on student. 

The final service offered by many college preparation programs is focused on the 
mechanics of applying to college. Individuals work with students on the college application 
process - how to pay for college, locate alternative sources of funding, and get started at college 
(e.g. selecting a dorm room, choosing courses). On occasion, these programs also offer financial 
resources to help defray the costs of college. Although some programs may begin earlier, the 
bulk of activity takes place in the 12* grade. 

College preparation programs generally have at least one of three foci: (a) academic 
enrichment; (b) college knowledge; and (c) cultural/social enrichment. Programs in the first 
category increase learning outputs; programs in the second category provide social capital to 
students who know very little about college; and programs in the third category enable students 
to have experiences that students in more affluent neighborhoods have (e.g. visits to Washington 
DC, a museum, etc). 

Service Providers 
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Although out-of-school programs frequently, although not always, take place at schools, 
the providers are usually not school staff members. Colleges and universities serve as significant 
providers of college preparation programs. Some providers are stand-alone non-profit agencies 
such as I Have A Dream (IHAD) or the Posse Foundation, and others are attached to a 
community or public service agency such as GEAR UP. The temporal nature of a provider’s 
engagement can be deceiving. A university, for example, may say that they have been involved 
with a set number of schools over a relatively long time period, but the nature of the engagement 
and the specific personnel involved may change considerably from year to year. Similarly, some 
programs such as Upward Bound have existed for a generation, but other providers have projects 
that come and go. These programs end not because of any particular weakness, but usually due to 
a lack of funding or leadership. Once the individual who has been the impetus for the project has 
left the project may die. College preparation programs, like out-of-school programs in general, 
also rely heavily on volunteer support. The nature of volunteerism is that individuals drop in and 
out of a program based on their own needs and demands. The result is that although providers 
may stay relatively stable, those who actually implement the programs vary a great deal. 

Program Funders 

The federal and state governments are the primary funding agents of college preparation 
programs. Foundation and private donations also provide significant support for individual 
programs. Virtually no college preparation has the luxury of long-term support. Indeed, the vast 
majority of projects live on soft funding from year to year. 

The lack of a stable funding base creates multiple problems and very few opportunities. 

In general, these programs are understaffed and under resourced. With soft funding, one 
significant activity for a program’s director is to locate funding every year. Financial instability 
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makes long-term planning virtually impossible. Staff members become anxious, believing that 
their positions may not be permanent or the project could dissolve within a year. As a result, 
good individuals will leave once they have found a job with a more stable funding base, and 
others may be attracted to the goals of the program but be unwilling to commit because the 
funding is not permanent. A valid and reliable evaluation schema is often difficult in a project 
that needs to prove itself every year. The push is frequently to show the funder that the project 
has been incredible, even when the evaluation does not support such a claim. 

Our purpose here has been to outline the varied nature of out-of-school programs and to 
point out how no one model exists with regard to the structure and pace of these programs. While 
it is unreasonable to expect that every program should function in the same way, a major 
problem that plagues these projects is that little sense exists among those who undertake the 
work about whether one approach is better than another. Imagine if the medical profession 
proceeded in such a fashion with regard to a cure for a major disease. Individuals would be 
encouraged to start treatments at varying times and intensities and for different purposes. In what 
follows, we turn to these issues with regard to the temporal structures of college preparation 
programs. 

Structure and Time in College Preparation Programs 
The potential strengths of college preparation programs are well known. As the Harvard 
Family Research Project (HFRP) has succinctly noted: 

Youth’s constructive use of their out-of-school time is a protective factor that has been 
associated with: (1) academic achievement (higher grades and grade point average), 
recovery from low academic performance, and an interest in furthering their education; 
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(2) a stronger self image; (3) positive social development; (4) reductions in risk-taking 

behavior; and (5) better school behavior and fewer absences (2004, p. 1). 

All of these potential benefits have weak results and end up being ineffective if the 
program’s temporal aspects are ill conceived, poorly thought out, or developed for reasons other 
than those based on program outcomes. 

Attendance 

Program benefits are not fully realized if the students do not consistently participate in 
program meetings, events, and other activities. Unfortunately, low attendance and/or attrition 
plague many college preparation programs, so it is difficult to completely recognize the full 
impact of these modules (HFRP, 2004). Distinct problems exist for programs with differential 
temporal frameworks. Districts that are organized on a year-round academic calendar must plan 
in ways that diverge from the options available to those who operate on a traditional year 
calendar. 

There are also choices to be made in determining whether to design and support a long or 
short-term program. Short-term programs often have specific goals such as SAT preparation, 
organized college tours, or career development workshops. Although students may well gain 
something from such projects if they attend for a few days, these sorts of programs should have 
clear evaluative benchmarks and a sense of how long it will take to measure the success of those 
benchmarks. 

If a project wishes to raise reading levels by a grade level, for example, and those who 
develop the pedagogy have designed the curricula with the knowledge that such a project will 
take five days a week for one month, then that is the temporal timeframe. If a student attends for 
a week or two and drops out, then the goal is not achieved and the project might be considered a 



11 




failure. Of course, indirect gains will be made by youth when they attend a program, but we are 
working from the perspective that college preparation programs need to have clear and 
measurable goals that are inextricably linked to the temporal timeframe that has been developed 
and implemented. To be sure, a small group of students might be quick learners and cover the 
material in a shorter timeframe than the majority of their peers. However, these students are 
exceptions to the norm, and programs should be built around norms that enable the highest 
possible success rate. 

In contrast, some programs exist over a significant time period. A project, for example, 
may begin in the 7* grade and conclude with high school graduation. The time-related 
assumption in this program design is that the activities the cohort of 7* graders experience along 
the way will lead to a higher rate level of college preparation. Programs organized in this manner 
lend themselves to a traditional experimental design. A cohort of 7* graders take a ‘treatment’ - 
the college preparation program. Another group is the ‘control’ - comparable students who are 
not in the program - where they carry on with their schooling as usual. The test is to determine 
how much the treatment impacts college going. For such a test to be valid and reliable, several 
conditions must be met. Foremost among them is that the treatment remains pure. Unfortunately, 
rigorous evaluations are rarely done of college preparation programs and, just as rarely, are such 
basic requirements met that ensure that the treatment group remains pure. Since many college 
preparation programs take place in low-college going areas, there are also ethical issues related 
to precluding some students from benefiting from such services as the result of being part of a 
“control” group. 

Programs that offer services over time usually require a student and family commitment 
beginning in the 7* grade. Attrition factors including school transfer, changes in academic 
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performance or lack of attendance hinder all students from completing these long-term 
obligations. It is not unusual to find that only a minority of 7* graders who begin a program still 
participate in the 12* grade. Assume, for example, that 300 students start a college preparation 
program when they enter the 7* grade. However by the 8* grade, 60 students either have moved 
away from the school where the program is offered (a common occurrence among low-income 
families), left the program because they found it uninteresting, or have not been invited back. In 
this situation the program lost 20% of its population. Such an attrition rate might not be cause for 
alarm if this were a one-year program. If the program loses 20% each year, however, then upon 
graduation the actual number of students who are in the program will be few. Unfortunately, 
such attrition rates for long-term college preparation programs are quite common. 

Further, the norm for such programs is that they exist by substitution. That is, the 
program has stated that they will have 300 students each year. If 60 students leave by the start of 
the 8* grade then they will simply add an additional 60 students from the general population so 
that the start of the school year begins with 300 students - 240 who are carryovers from the 7* 
grade and 60 new students. In actuality, two cohorts exist, but they are being treated as if they 
were one. In 9* grade the same problem arises and is compounded. Three cohorts now exist. The 
end result will be that 300 students are likely to be in the program upon graduation from high 
school, but the temporal impact has been negated. As with the short-term program, if program 
designers begin a project by suggesting that the treatment needs six years to take effect, then 
what is actually happening if a student enters in the 8* or 9* grade or the 1 1* or 12*? To claim 
that the program has had an impact is virtually impossible, if not absurd. Aside from multiple 
other issues that arise - such as contamination from other related programs - the project 
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designers have created a very expensive long-term program that can claim no standard goal or 
success rate. 

Attendance is foundational. However elegant a pedagogical design may be, or clever and 
insightful the teaching staff is, if students do not attend the program, then one cannot claim the 
program had any impact. If a program suggests that what occurred for a handful of students in 
one year is equivalent to six years, then obviously the program should be cut down to one year. If 
a program is not clear about its temporal framework, then whatever else follows is moot. 

The reasons for attrition are manifold. Students frequently need to work to earn income 
for the family or themselves, or they simply want a bit of free time. Sometimes adults forget how 
busy students are. They attend school and have familial and/or work obligations and a variety of 
additional out-of-school activities that they view as necessary. If the college preparation program 
is just one commitment among many, then it may fall by the wayside when other obligations 
come to the fore. 

Programs also may be ineffectively structured to engage students over time. Additionally, 
when college preparation programs are voluntary, students are not obligated to attend. First 
generation (and most other) students know that when adults ask about their post high school 
plans, the correct answer is “I want to go to college.” However the reality of college, the amount 
of commitment for preparation, and its benefits is a mystery to individuals who have few college 
role models to look toward and who do not understand the intangible benefits of what seems to 
be a far-off undertaking. The possible result is that attendance at college preparation programs is 
sporadic, may compete with other immediate interests, and may help to explain why attrition is a 
significant factor. 

Participation 
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For over a decade a great deal of research has pointed out that regardless of whether 
students are in junior high or college, male or female, African American or Latino, they do better 
in classrooms where they are actively engaged. Again, the temporal aspect of such an 
observation for college preparation is a critical point. Simply stating that students had a “four- 
week” program or that they had “30 hours” of writing instruction in a program does not explain 
if the student learned. We place this element after attendance because obviously one needs to 
have students attend a program. If the seminar is four-weeks or the writing instruction is for 30 
hours, then the first step is to have students meet the overall temporal framework. But once that 
foundation is set, the concept of time remains important, but becomes a bit more difficult to 
evaluate. Rather than assume that hours spent in a program naturally leads to learning outcomes, 
the challenge is to evaluate how those hours are spent. A simple rubric is to assume that the more 
time students spend actively engaged in learning activities that the more likely learning will 
occur. Conversely, the more time that is spent where students are passive and disengaged from 
the material indicates that learning outcomes are likely to be less impressive. 

Participation also may be looked at with regard to familial involvement in a program. We 
know that when parents are involved in their child’s education that positive outcomes are more 
likely to happen than when a family is disengaged. Thus college preparation programs where 
parents have the ability to participate by spending time in some aspect of the program are 
beneficial. If attendance assumes that students need to put in their time to achieve outcomes, 
participation turns that notion on its head. Participation asks how students spend time and if the 
activities in which they are engaged provide opportunities to learn. 

Duration 
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A project’s duration, as with our commentary about attendance, should be connected to 
learning activities. However, often a program exists for a set period of time because of the 
availability of resources and personnel, rather than achieving learning outcomes. Programs that 
survive on soft funding create proposals geared toward funding the personnel who are employed, 
rather than a testable model that says that students need x weeks or months to learn a particular 
activity. As noted above, college preparation programs have diffuse goals that are largely not 
evaluated. If an evaluation were to be done, then one key question pertains to if the work of the 
program could be done more efficiently in a shorter time frame, or if the project were extended if 
the students would experience increased learning outcomes. Such questions are rarely asked and 
the temporal timeframe is simply developed with an eye to what can be accomplished with the 
funds that have been provided. 

The focus of a particular program also helps define how long it should last. For example, 
one can predict whether a high school senior will be able to attend an institution in the University 
of California (UC) system. Students need to have completed a specific set of courses by the time 
they graduate from high school. If they have not started down that path by sophomore year, then 
they most likely will not meet the admissions criteria for a UC. Thus a program aimed at 
increasing access to college for all youth in a group of high schools that starts in the 12 '^ grade 
will not have a long enough time span to affect the largest body of students. Conversely, the 
actual steps required for applying to college occurs primarily at the end of 1 1* grade and 
throughout senior year. A project that starts the formal process before that time will not be using 
its resources wisely. Students need usable knowledge. Yet information about FAFSA forms in 
the 9* grade seems abstract and is forgotten by the time it is needed. The point here is that 
information and learning go hand in hand with the temporal framework that has been developed. 
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If program designers ignore temporality, then the use of information and the goals for learning 
are likely to be ineffective. 

Intensity 

First generation low-income students in low performing schools face multiple obstacles 
en route to applying to college. Students frequently are not reading at grade level, and they lack 
the college knowledge to navigate the process on their own without adult support. College 
preparation programs in low-income neighborhoods largely exist because the schools are not 
preparing students adequately. Enrichment programs for the wealthy are simply that - 
enrichment on what has been learned in the classroom. In low performing schools, college 
preparation programs are not developed with an eye toward enrichment. Instead, they are 
designed to overcome what has not been learned in school and is needed for college. The result is 
that students need out-of-class learning activities that are intense and occur over a significant 
period of time. It is not necessarily a truism that the more students are involved in a project the 
more they are likely to learn. As we noted above, if students are passive participants in a project, 
then they will not gain as much from their time in the program as those students who are active. 

The intensity of the learning experience makes a difference. Some directors believe, for 
example, that junior high school is a particularly difficult time for youth and so develop a college 
preparation program that is intensive in the junior high years and less so throughout high school. 
Such a program might be compared to an inoculation, where students receive the equivalent of 
an academic vaccine in junior high school that is supposed to maintain their academic health to 
graduation. This thinking is misplaced. Poor students in low performing schools need constant, 
intensive support from junior high school through to graduation. 
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Learning gains are temporary if they are not constantly supported. If students increase 
their math and reading proficiency by one grade level as a result of a summer program, then they 
will regress if they do not have similar learning opportunities throughout the school year. 
Similarly, an increase in counseling for junior high youth, although warranted, will have 
negligible effects if similar services are not provided throughout high school. The result is that 
money and effort are wasted if the time is spent on an inoculation in junior high that will not 
have lasting effects. 

Similarly, student needs change over time with regard to college knowledge. In junior 
high school, students need to know that going to college is a doable goal to which they should 
aspire. As they move through high school, however, students more specific information and 
preparation. SAT preparation, for example, is useful in the 10* grade and much less so in the 
12*. A great deal of college preparation needs to occur throughout the high school years for low- 
income youth. Consider that in high performing schools and in wealthy areas discussions and 
preparations about college are regular, ongoing, and supported by the school and family. By the 
time a student actually applies to college in the 12* grade, she or he will have had a wealth of 
activities and interactions that do not take place in a high school in a low-income neighborhood. 
Insofar as a college preparation program’s goal is not to change the school but instead to provide 
absent experiences, it should include intense and longstanding activities occurring from the 7* 
through 12* grades. 

What the research does not demonstrate is how to define intensity. At present, the 
definition of the term is a bit like Justice Blackman’s comment about pornography - he knew it 
when he saw it. Anyone who studies college preparation programs is likely to agree that a 
monthly 4-hour writing class offered during the school year without any significant intermediate 
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follow-up activities between classes is unlikely to yield meaningful results. Similarly, a 
mentoring program where a mentor meets with a student for one hour a month will probably not 
yield tangible accomplishments. Such interactions may be pleasant, and they may have indirect 
effects, but if the goal of the program is to increase college going, then the project will not reach 
its goals without intensive interactions. 

Spending Time: Where Do We Go From Here? 

The discussion offered in this paper demonstrates how much is unknown about out-of- 
school programs from an empirical perspective. Little evidence exists that will satisfy the 
researcher concerned about scientific proof. Perhaps there is the greatest paucity of literature 
with regard to the costs of such programs. As Lind et al. note, “Researchers and practitioners do 
not have a standard methodology for estimating the full costs of out-of-school time programs” 
(2006, p. 1). The result is that temporal decisions are made almost entirely based on what a 
program director can do with limited funds that shift from year to year, rather than proven 
strategies that accomplish what a program has set out to do. 

Some program directors resist evaluation, which is lamentable insofar as they have no 
basis on which to judge whether the project is successful. The more common norm is that 
evaluation seems like a luxury when a project is understaffed and under funded. The result is that 
when we look at the out-of-school time landscape even similar programs with similar objectives 
have widely varying temporal structures. Some programs assume that intense involvement with 
junior high youth will carry them to college, and other projects maintain a constant interaction 
with students from year to year. Some projects assume that seat time is the guiding factor, and 
others recognize that such a point is irrelevant if students are not learning anything but are unsure 
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how to assess what is taking place. If asked how they have developed their program relative to 
cost, most programs will respond logically that they do what they can afford. 

Although research that adheres to strict guidelines demanded of experimental design 
studies is largely absent, some conclusions may still be drawn. We are not suggesting that the 
literature provides no clues about how such programs should spend their time. In particular, we 
offer four suggestions that pertain to the temporal dimensions of college preparation programs. 
These suggestions are framed by two assumptions. 

First, we concur with Robert Halpern’s point that “low-income children, as all children, 
need times and places in their lives where the adult agenda is modest, if not held at bay; where 
the emotional temperature is low, and acceptance is generous; where learning is self-directed, 
experiential, and structured to be enjoyable . . . After-school programs are well-suited to meeting 
these needs. Yet as the societal spotlight turns to after-school programs, they are increasingly 
being asked to take on the very different role of academic remediation (2000, p. 186). 

Halpern’s point is well-founded. College preparation programs should be parsimonious rather 
than expansive. They should adhere to clear goals so that not every second of every day is taken 
up by schoolwork. 

Nevertheless, our second assumption is that dramatic change in public schools is not 
going to come overnight. The result is that a need will exist for college preparation programs for 
the foreseeable future. We acknowledge that almost half of the hours that exist in a school day 
are not utilized for academic purposes (Marshall, 1993; Smith, 1998). Such observations 
underscore the fact that too many low-income students graduate from high school without 
adequate college preparation and either do not go to college or complete their degree. We also 
know that “there are fairly consistent results . . . that after-school programs promote greater 
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parental involvement in school, greater student engagement, and greater student commitment to 
homework” (Kane, 2004, p. 5). Programs for college preparation should improve how they 
structure the time students spend in them. The basic need for their services will continue in the 
foreseeable future. If these points are correct, then what guidelines might a program call upon 
when thinking about the temporal dimensions of their programs? 

Clarify Goals 

Far too many programs have generic goals that defy evaluation and do not point 
individuals toward a specific outcome. “Love of learning” or “to increase access” are admirable 
mission statements, but they do not explain how to determine if the program is successful. 
College preparation programs need to get students ready for college. The underlying assumption 
has to be that if this program did not exist, then a specific cadre of students would not only be 
less prepared for college, but presumably, they would not go to college. Obviously, programs 
will work with different clienteles - students who are urban, rural, high achieving, 
underachieving, among others - and they will have diverse curricular foci - reading, math, 
science, etc. However, unless a program specifies what its goals are, the temporal framework that 
should be built will be simply a guess. 

How time is spent must be hinged to a program’s goals. Goals should be specific, real, 
and achievable. Currently, a vicious cycle exists where funders expect programs to demonstrate 
significant goals. So programs state they will achieve high goals, and even though they are not 
proven, the programs will return the following year with claims of remarkable success. As 
Granger and Kane point out, “We need to be more realistic about what it takes to create 
discernible effects on achievement test scores” (2004, p. 52). They go on to point out how 
difficult it is to raise reading scores. The expectation that a revolution in reading scores will 
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occur is impractical when an after-school program has students for a few hours. We agree. Yet it 
is possible for college preparation programs to set realistic goals that reflect what they want to 
accomplish that, in turn, will define how they structure their time. 

Develop a Timeframe that Meets the Program’s Goals 

We have outlined above what we have defined as temporal elements. Attendance, 
participation, duration and intensity all revolve around the kind of goals that the program desires 
and the curricula and pedagogy that will be developed. If students are to attend a program that 
will require a great deal of time, then discussions need to occur with students and their families 
about how to manage time. Those individuals who develop the curricula and pedagogy should be 
informed intellectuals who have some background in curriculum development and what amount 
of time they will need to accomplish the goals that have been outlined. 

The curriculum should be reviewed not only with an eye toward the goals, but also with a 
sense of how students are to be engaged in the program. Given what has been proven about the 
importance of student involvement in their own learning, one key objective of a program should 
be how to enable students to participate and make good use of their time. The duration and 
intensity of the program cannot be determined with precision, and such an attempt would be 
absurd. No one will be able to predict that 16.5 hours is the correct time to allot, for example, 
rather than 18 hours. However, any trained external observer can point out whether an approach 
will achieve its goals and whether a project’s timing and pace will enable its set objectives to be 
realized. 

Enable Students and Parents to Understand the Importance of Attendance and Participation 
A three-fold challenge exists with regard to student attendance and participation. First, 
college-educated adults may think that college access is of critical importance, but first 
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generation low-income students and families frequently do not or at least do not necessarily 
believe that spending time outside of school is of high priority. Second, programs often make 
attendance difficult because they have not taken into account student and family needs. Holding 
a seminar for students, for example, on an evening when students regularly attend a church 
service is undoubtedly going to create a conflict where students and families have to choose one 
event over another. Third, most students - especially those for whom these programs are 
developed - do not look at their high school classes as fun or exciting. Consequently, offering an 
out-of-school class does not sound like a particularly enjoyable way to spend time. 

Such problems are not insurmountable, but they do require dialogue. Students and parents 
need to be made aware of the program’s payoff and frequently that payoff must be described in 
monetary terms. Those seminars across the country that point out how much a student will earn 
over a lifetime if he or she goes to college are simple and effective messages about the 
importance of attending. Once that message has sunk in, then the program requirements need to 
be clear. The implications of missing classes or tardiness should be outlined and enforced. The 
vast majority of students and their fa mi lies want to succeed, but what success means and what 
they must do to succeed is not always clear. 

Curricula should be developed so that it is not in obvious conflict with other activities. If 
football is a major event at a high school, for example, then scheduling classes on a Saturday 
may not be the best way to excite students, but a Tuesday afternoon may be fine. We know that 
out-of-school options are jammed and that choices always need to be made. However, far too 
often out-of-school offerings are developed in isolation from schools, communities and churches. 
A successful out-of-school program will work in consort with these groups. 
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Those who teach should be culturally engaged professionals who know how to make 
learning exciting and fun. As the Harvard Family Research Project has observed, “When youth 
are happy with their OST [out-of- school time] program, they describe it as a family. They 
develop a trusting relationship with the OST staff members and feel that they care about them” 
(2004, p. 8). The crucial point here is to make explicit choices about who will teach and staff 
these programs accordingly rather than simply choose individuals based on convenience. 

Develop an Evaluation Schema that Investigates Temporal Dimensions 

One theme running throughout this paper has been the importance of evaluation. 
Evaluation might be thought of as a continuum where on one end no evaluation is done and on 
the other are studies that meet rigorous scientific criteria. Although we have previously written 
about evaluation (Tierney, 2002), very little has changed. Our purpose here is not to delve into 
why evaluations are not done, but rather to urge that some form of evaluation exists that is 
beyond the domain of a program director’s year-end ho-hum summary to the funder. 

The temporal dimensions of a program need not be steadfast. As program goals change, 
so too might the timeframe developed to carry out the program. The only way to gain a sense of 
whether one timeframe is working as opposed to another is to gauge what takes place by way of 
various forms of evaluation. Feedback mechanisms also are likely to occur. If a program 
develops ambitious goals and an evaluation points out that only with a significant increase in the 
program’s intensity will it be able to achieve them, then the program may need to revise their 
preliminary aims. A high performing program is one in which the various components are in 
sync with one another and out-of- school time is spent in a manner that supports the goals that the 
program participants have set for themselves. 
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